HDInsightSparkEnvironmentEvents

Browse: 🏠 · Solutions · Connectors · Methods · Tables · Content · Parsers · ASIM Parsers · ASIM Products · 📊

Back to Tables Index


Reference for HDInsightSparkEnvironmentEvents table in Azure Monitor Logs.

Attribute Value
Category Azure Resources
Basic Logs Eligible ✗ No (source)
Supports Transformations ✓ Yes (source)
Ingestion API Supported ✗ No
Azure Monitor Tables Reference View Documentation

Schema (24 columns)

Source: Azure Monitor documentation

Column Name Type Description
_BilledSize real The record size in bytes
_IsBillable string Specifies whether ingesting the data is billable. When _IsBillable isfalseingestion isn't billed to your Azure account
_ResourceId string A unique identifier for the resource that the record is associated with
_SubscriptionId string A unique identifier for the subscription that the record is associated with
ApplicationId string The application ID of the application producing the record.
ClusterDnsName string The DNS name of the cluster running the application.
ClusterTenantId string The tenant ID of the cluster running the application.
Host string The FQDN of the host.
IpAddress string The IP Address of the node running the application.
Region string The region of the cluster running the application.
Role string The type of node running the application.
SourceSystem string The type of agent the event was collected by. For example,OpsManagerfor Windows agent, either direct connect or Operations Manager,Linuxfor all Linux agents, orAzurefor Azure Diagnostics
SparkDeployMode string The spark deployment mode of the application.
SparkExecutorCores int The number of Executor cores.
SparkExecutorInstances int The number of Spark Executor instances.
SparkExecutorMemory string The memory usage of the Spark Executor
SparkMaster string The master mode of the Spark Application
TenantId string The Log Analytics workspace ID
TimeGenerated datetime The timestamp (UTC) of when the log was generated.
Type string The name of the table
UserSubscriptionId string The subscription ID of the cluster running the application
YarnMaxAttempts int The max number of attempts Yarn will make for the application.
YarnQueue string The type of YARN queue for the application.
YarnTags string The YARN tag of the application.

Resource Types

This table collects data from the following Azure resource types:


Browse: 🏠 · Solutions · Connectors · Methods · Tables · Content · Parsers · ASIM Parsers · ASIM Products · 📊

Back to Tables Index